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ABSTRACT 

An Optimal vocational evaluation prcgram is described 
which was prcJvided as par* of a treatment of vocational and school 
bGt\aviors of 11^ reluc+ant learn.iprs from twenty-two rural school 
districts. (The 60-hour vocational evaluation process inv^olved 
out -/3f -school psychometric and work sample testing ever a 'two-week 
.period,) An alternative in-school- variation of that program is 
suggested and the effects foenerally positive) of the original 
proqram on learners are ^^ummarized. Three perspectives are discussed 
with respect to +he use c^ vocational evaluation in rehabilitation 
and educational applications: as an information gathering process, as 
a Qlient- react i ve process, and a rehabilitative process- The central 
components of a varie + y. of educational experiments are examined as 
tratalysts for increasing *he relevancy of education and fcr effecting 
changes in behavH.ors of special need<5 students. Vocational evaluation 
i?? identified as a key cat'alys* for affec+ing the vocational 
development and school beha v^ ors of the reluctant learners in the 
threG-!itep Egual Career Opport unf t ie-?: Program (ECO): (1) in-school 
identification; (2) out-of -school vocational evaluation; and (3) 
in-school followthrouah . Tn ^he alternative model which is suggested, 
vocational evaluation and career ouidance are formally joined into a 
one- or two-semester course, *he terminal oblective being that 
students will establish realistic vocational plans and be provided 
with- necessary school resources to attain *-hese goals. The evaluation 
of the effects of vocational evaluation on ^the ECO students* 
vocational development and school behaviors are sumirarized and\ 
presented as suggested minimum levels for the in-school model-/T\ 
(Author/MEK) (J 
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ABSTRACT . 



The intents of tjfiis report are to describe an optimal vocational evalua- 
tion proqram provided as part of a treatment of vocational and school be^iavlors 
of reluctant leawri^rs; to suqqest an alternative in-school variation of 
that proqram; and to summarize the effects which the original proqram had 
on reluctant 'learner behaviors. First, three perspectives of vocational ^ 
evaluation a're discussed respective to vocational evaluation's use in 

V- ■ ■ ■ ■ 

rehabil i ption akid educational appl icati-ons (as an information qatherinq 
process, as a cl ieht-reacti ye process, and as a rehabilitative process). 
Next, the central componen^ts bf a variety of educational experiments are 
^discgssed as catalysts for increasino the relevancy 6f education and for 
effecting ch^nqes in behaviors* of special needs students. 

Then, the Equal Career Opportunities Program (ECO) was outlined as a 
three-step proqram (in-school identification, out-of-sch(^ol vocational 
evaluation, and in-school follow-through) with vocational evaluation as a 
key catalyst for affecting the vocational development and school behaviors of 
reluctant leraners in rural schools. Based on the description, the ECO 
(proqram, and the research and evaluation studte^ conducted on it, a two , 
component, in-schoal model is proposed. In t^at model, vocational evaluation 
and career' guidance and exploration are fully integrated; such that the 
benefits pf ec/ch can be complimentary. Evaluation and guidance a'i^fonnally 
joined -into a one* or two semester course, through which students can establish 
realistic vocational plans and school personnel can obtain those resources 
I msot needed by students to realize their vocational goals. Finally, the 
evaluation of the effects of vocational evaluation on the ECO students' 
vocationaf- development and' school behaviors were summarized and presented 
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^ as minimum levels which mi~ght be optimized with the model in-school program. 
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I. INTf^ODUCTION 

This report is addressed to developers and generators of evaluation' 
programs in both rehabilitative and educationdkl settings.- The audience of 

this report includes personnel dealings with special needs/disab'led persons 

■> 

in rehabilitation facilities, in vocational technical schools, and in secon- 
dary education evaluation, career development, and guidance programs. The ' 
purposes of this report are threefold- (1) to describe an optimal vocational 
evahjatiw program provided as part of a "treatment" .of vocational 

* ft 

and school behaviors of a group of students known as "reluctant learners;" 
>(2) to suggest an ^integrated variation the' original program; and (3) 

■ 1 

.to^urtimarize the evaluation of the effects of the optimal program on the 
students' vocational and school behaviors. 

Since the onset of PL 93-112, vocational eval uation has increasingly 
been employed by rehabilitation counselors to obtain needed information 
on their clients' potentials and limitations. The use of this information 
is obtained at two points in the traditional rehabo 1 itatjon process. \he 
first point is w^)en the client is still a "prospective cM^rrt^of the state 
vocational rehabilitation program. At this poiht, the information from 
evaluation is used in the process of determining whether the prospective * 
client is eligit^le for services. To be eligij^le, according to federal • 
legislation, the prospective client must have a "severe" disabi 1 ity" and a 

potential .for w)cational rehabilitation. That is, at this point the counselor 

It * 

is using the Information from evaluation (along with the. medical , social, 

etc.) to determine whether the prospective client has rehabilitative 
potential, given the resources of the system-. 



The socond point at which vocational evaluation is most typically used 
is after the client has been accepted for services ( i s el igible) . The 
purpose here is for developing the client's Individual Written RehJibi 1 itat ion 
Plan (INRP). The IWRP becomes the basis upon whi^h all future services 
(adjustinent, skill training, education, prosthetics, medical , psychological, 
>etc.) and supports (maintenance, housing, transportation) are obtained for 
the client as part of his vocational rehabilitation. This TWRP is developed 
jointly by the client and counselor based upon the information tl>at is avail- 
able to the two of them (including the evaluation findings). The long term- 
goal of all IWBP's is to return the client to his optimal level of competi- 
tive employment, or if competitive employment is not possible, to an environ- 
ment in which the client c'^make his best contributions. 

At both these points, the information derived from vocational evalu?i- 
tion is the outcome of vocatN'onal evaluation and this information .is used 
in decision-making and for further planning. To many rehabilitation per- 
sonnel,, vocational evaluation is exactly this and as it was originally 
desigped to be: a diagnostic and assessment process from which a succinct 
and objective afppraisal of individuals' vocational and social assets and 
limitations are to be obtained. ' " 

To others, though, evaluation is becoming viewed as a treatment process 
as well. Direct benefits to clients are anticiapted by those who hold- 
this point of view. Some of the benefits logically deal with the' clients 
gaining new and unprecedented information about their own vocational strengths 
and weaknesses; gaining new information about occqpational outlets and - 
alternatives of which they were previously unaware; gaining new- insights as 
to their own vocational potential for either Employment or skill training; 
gaining new information on their own behavioi^s, emp'loyment' history, social 
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background, educational >?istory, disabilities, etc; and gaining new under- 
standings and insights into how these factors may have important bearing 
on previous employment/training and how they may imRede or enhance their- 
employment in -the future. Accordin-g to this view, clients are rtot seen 
as passive individuals from' whom data are gathered and on whom profiles 
are generated. Rather, clients are seen irs reactive. They are recipients 
and processors of in forma WoVi. They go through the evaluative task and 
either respond to. or ignore information (the scores and other performance 
•data) which are formally or informally reported to them. 

Even in this view of clients as reactive and responsive, the focus 
is upon information gain. Here, though, the clients gain something from 
evaluation as well as does the counselor who pays for-th^ evaluation. This 
viewpoint is quite consistent with the prevailing concept that clients 
actively engage in developing their rehabilitation plan (the IWRP). 

The most extreme view held by some is that the client is proactive 
and has an importlnt bearing on the program described here. Under this 
view, clients are not only reactive, in that they gain r\ew data^ information, 
and/or insights about themselves, but as' they receive this new information, 
cognitive ^d affective effects take place. Essentially, learning occurs 
.at what Bloom might refer to in his taxonomy of objectives as the "level 
of integration." ^ 

As a result of such a "true treatment," one might expect that clients 
would have a different attitude about work, be better able to plan and make 

it 

decisions as to what they want to do vocationally, have different concepts 
about themselves as' vocaViona 1 and social beings, be more goal -oViented, 
look for and pursue more vocationally relevant aspects of the activities 



and/or expeT-iences- in theirtlaily lives. As even a "qua«ti treatment," 
those who hold this view would contertd that these same benefits are est^b- 
lished or begun by the evefl uation' process , and should either be formally 
encouraged as part of the' evaluation services or provided adjunct to 
evaluation. 

Educators have long recognized the presence of a significant subculture 
in their schools composed of the di^dvantaged, the handicapped, the learn- 
ing disabled, the underachieyer , the youthful offender, the school drop- 
out. This collective group, presently referred to as special needs students, 
does not respond to the traditional school offerings in the expected fashion. 
To adequately serve'Hhem, a variety of educational experiments have bfeen 
undertaken to bring greater relevancy to their school experiences. 

Many of these experiments, whether under the guise of career education 
programs, counseling programs, or work, experience programs, attempt to 
integrate the several experiences in which students are involved with respect 
to the relevancy that their education might have- to fut-ure vocations or 
careers. Some of the more successful approaches have attempted to identify 
a major "catalyst" around which the educational experiences of specific 
'.target groups can be coord'inateci. The intent is that- this catalyst will 
a.ide in integrating experiences such that the students' education will be 
as relevant as possible. - Many such programs employing a catalyst are contained 
in educational Ifterature: Richmond planned interdisciplinary courts 
(Kincaid and Hamilton, 1968) and Wellesley Hills made radical changes in 
curriculum and physical setting with underachievers "(Freeman and Craig, 
1970).. Suwanee, Georgia used reading, job placement, counseling and super- 
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vision, health, child care, and social services with school dropouts 
• (Crawford, 1974). Watertown, South Dakota used career oriBntation and 

exploration through an otcupational information center (Watertown, 1973). 

Brooklyn (Corenthal & Gold. 1969} and Knoxville( Jolly, 1971) used career • 

exploration, job tryout, and in-school guidance to correlate exploration 

in^ experience 'With school ing . for the disadvantaged . St. Louis (1959), 
•Ohio (1967), and Pittsburgh (1968) used work experience programs with a ." • 

variety of disadvantaged, minority, drppouts, under-achievers and youthful 
' Offender groups. Dayton (1974) united academic and vocational, lab courses 

in an attempt to demonstrate interrelatedness and relevancy of school to 
work. . Hartford (1969) used extensive testing and specific occupational 

training and Minnesota (Krantz ,jl960) used vocational evaluation Vith junior 
and senior mentally retarded, dropouts, and underachievers t-o provide them 
an understanding of their capacities to enter the e'm^loyment market.'. . ' 
Finally, the many in-school and out-of-school work experience programs 
sponsored by CETA us^d work as a catalyst with economically disadvantaged 
youth. . 

These .programs have used work and fhe^ integration of school/work 
experiences as a catalyst to improve a variety of such educationally relevant 
student characteristics as school performance, attitudes, self-concept, 
general achievement, potential to graduate, vocational skills, and employ- 
ability. Strong support for the basic contention that work or. focusing on 
the role of wo>;-k is an effective catalyst has also been suggested by the 
research and demonstration findings of Sexton (1961), Deutsch (1964) and 
Clark (1965) that traditional academic programming has little meaning 
for disa<tVantaged youth. Further, Herzberg (1959) ^nd Ford (1969) have 
found that the context of work itself can be effectively used to motivate 
workers. 



Potential of Evaluation iVi Education 

The view that evaluation has benefits aboye and beyond information 
gain for a referring source has a certain attractiveness to it, both logi^ • 
cally and practically for rehabilitation practitioners. Giv^h that a ^person 
can spend anywhere up. to Sleeks being ^evaluated, it is quite likely that ' 
something is ^going to happen to h'im. Too, given the .rather high cost of this • 
service, rehabilitative gains accrued by the clients would furt^ver help 
justify continued use of evaluation with different cn>nts in the tradi- « . 

I 

tional rehabilitation application in.^-wWch it is general ly used. 

In e^ducational applications, the use of vocational evaluatfbn both'' 
the traditional sense and in the sense- that it has treatment .effects is^^ 
also quite attractive. Matthew (1^) suggests that motivation and impact" 
of the types of innovative educational ex|beriments with special needs groups, 
like disadvantaged youth,, requires an accurate determination of .the capa- 
bilities of these youth. Among thos^- commendable programs cited above, 
the emphasis on integration was' preclominantlx in terms of providing students 

with a sound connection between the experiences and skil 1 s which school 

■ $ 

provided and their vocatipnal future. While assessment of capabilities « • 
was one aspect in many of- the program^ , it was only in the Hartford (1969) 
and the Minnesota (Krantz, 1970) programs, where testing or evaluation were 
ascribed a clearly critical role. . ' 

In recent years, social and. economic changes in- our society have 
fostered a serious consideratipn of career exploration, career education, 
career guidance^ and vocational and technical education-' in both secondary, 
and post-secondary schools. A rightful place is now being awarded to schools 
for preparing students to enter and ijiove around in the world of worlc^ 
Schools are now seeing that they. must concentrate on meeting student needs 
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to develop employable skills and to develop- skills related to vocational 
decision-making. - . " . ^ . 

A wider range of groups also appears, to be in n^ed of special services 
from education. Along with the cultural ly^disadvantage^ and- the handicdipped, 
such, diverse groups as school, dropouts., returning veterans, persons making . 
mid-career changes and women reentering the world of work are also 1h need 
of what education can and does offer. Each of these groups are* seeking 
training in new or alternative vocational skill areas. As often as not, 
they are hampered by a lack of accurate information about" their vocational 
skills, potentials, and appropriate. direction. Likewise, the^ programs which * 
are to serve their training needs lack this same information. Schools 
need this information to guide these persons into programs which will most 
efficiently meet their real needs. ' ' • ' 

.) . 

Di^nostic assessment is becoming increasingly popular in secondary - 
and post-secondary technical education programs. Vocational evaluation 
is being seen as an alternative to the traditional, paper and pencil diag- 
n-ostic assessment approach which has been found to have some grave limita- 
tions for special needs populations. This consideration of evaluation a^Mie. 
an aVternative, though, is not without recognized financial drawbacks. 
These cause some funding agencies to question whether it really is a viable 
alternative. • 

The per person cost of evaluation is high, as evaluation requires 
professional skills (which are often ti*mes not possessed by existing guidance 
personnel), specialized equipment, physical facilities, and a fair amount 
of time to conduct. If, however, these costs represent not only diagnostic 
but educational benefits to "student target groups" as well, then the view 
of evaluation as a treatment or catalyst is as attractive to educators as 
it is to rehabilitation professionals. Evidence, however, is needed to 



demonstrate that important vocationa]^nd educational benefits are accrued. 
The Equal Caree^ Oppo^rtunities Program was one such program which used 
vocational evaluation as a catalyst^ with high school "reluctant, learners." 
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•II. VOCATIONAL EVALUATION WITH. ADOLESCENTS 

Tho Ec^^ijal Cdrtw O|)|\orturvi\ti\)s Pr^^ 

*Tho Lqual Career Opportunities Procjrdm (ECO) used vocational evaluation 
as the catalyst in an overall program designed to integrate school ^nd 
potential vocational pursuits. Evaluation was to serve as a catalyst for 
adjusting existing educational programs and resources in the school for 
students (the traditional use of -vocational "evaluation findings in plan 
development) and as a catalyst from which effects of e\^aluation might be 
found to foster greater goaT- directed behavior among students. 

ECO served high school students referrecl by 22 small rural school 
districts in Northwe^M^i scons in. Students referred by the schools were 
in their sophomore and junior y^Srs and werje known as "reluctant learners." 
Reluctant learners represent approximately 6% of, the students in rural ■ ^ 
schools. According to the criteria used by teachers and" counselors for 
identifying students eligible for ECO (CESA 5 and 6, n.d., C-39), reluctant 
learners possess five basic characteristics which are relevant to their 
not fully profiting from the education presently available to the'm in the 
schools'; 

1. High Absenteeism or -Tardiness. Misses school to the extent that 
^ progress or achievement of a high school education is impaired. 

2. Behavior Problems. Manifests type(s) of behavior which cause lack' 
of school progress. . *^ 

3. Underachievement. Grades are not maintained at a^revel- of performance 
compatible with abilities. " 



4. lack of Goal Direction. Is not able to relate his education to. future 

♦ 

needs of vocational goals. 
b. Limited Abilities. Academic problems as a result of being a slow 
learner, poor reader, etc. 

The overall program consisted of the sequence of experiences depicted 
in Figure 1 and a set of materials. The program made available four sets 
of materials to teachers, counselors, students, and their parents in the 
form of guides, {C^SA 5 and 6, n.d.). Each guide basically cjovered the 
same general content,^ but was directed at the specific concerns which might 
be had by each. The Teacher Guide and the Counselor Guide provided a 
description of the program and hov*' evaluation could be used to effect pro- 
graniTiing for reluctant learners within the existing resources of the school. 
The Teacher Guide particularly emphasized criteria for identification and 
referral of those students of whom teachers were aware were reluctant 
learners in tfheir classes, as teachers were the primary source in the ini- 
tial identification. The student Guide, in turn, described what evaluation 
would involve, what might be expected to happen during "Valuation , and how 
evaluation findings might be incorporated in their school program after they 
completed evaluation. This ggide was used by both students and their parents 
The last guide was directed toward counselors and admin istratbips and 
^described the types of work samples and psychometric tests used as' part of 
evaluation and what types of information would t?e sought frp»rthem. 

As shown in" Figure 1, the sequence of the program involved vocational 
evaluation as the pivitol catalyst in ECO's working with the schools, 
students, and parents to maximize educational opportunitieT for~tlie~s^u3enTs7 
Duf-ing the pre-vocational evaluation phase, teachers identified reluctant 




\ 

1 earners usinq the criteria listed in the quides an^ whom the counselors 
them recoaiiKMi^ed to ICO for evdludtion. As the number of eyaluatjon slots 
were limited, it was necessary, in some c.i.ses, for counselors to rar\dojnly 

, select a smaller nuinhcr from those st\r'def»ts. which teachers considered eligible. 

¥^Also during this tiii»e, staff provided in-service sessions for teachers and 
counselors to clarify whot the £C0 program was, how students were to be* 
selected, and how adjustments .might be made in the regular school offerings 
for th^se students after evaluatuon. * 



Figure 1. The ECO Program Structure 



.In-School 



Out of School 



^ In-School 



IDENTIFICATION, 
ORIENTATION, 
COORDINATION 



VOCATIONA^L 
EVALUATION-: 



MMPLFMFNTATION, 
COORDINCAjlON 
FOLLOW -THROUGH 



Once students were identified, staff met with both students and parents 
to review what the evaluation program would be, how it might impact on the 
studen't,'s .schooling, how- the student was selected, what would be reqCilred 
of the stijdent, how the student would be affected, and to obtain parental 
consent. All data needed from the school for vocational evaluation were 
then obtained. Students entered vocational evaluation the following semester. 

At the conclus^?r^f^vocajtional ^valuation, an extensive evaluation 
report was prepared indic^n/g the psychometrics and worlysamples used 
to evaluate the student;, immediate and long term vocational recommendations; 
recommendations as to e(^ucational , social, psychological , 'and training 
experiences which the student needed; and included othe/da'ta to support 
the recommendations. At this stage, ECO staff worked closely with vocational 
evaluation staff so that the latter recommendations could be phrased iti terns 
of available resources in the student's home and school and the expressed 
concerns and reactions which the student might have to thos0 recommendations. 
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^ \\\Hm roturi) to th(> school, FCO st.^ff ihon worked with teachers and 
counselors on how and when to t)est implement specific recommendations. • 
At tMe same time, staff also btHjan fol low-throuqh activities with students 
(Hid pdHMits. Tfiis fol low-throijcih focused fir^t on reviewing the findings 
of the evaluation reconwnendat ions and the probable changes in the program 
and the student which would be necessary, Theji regular and ''periodic in- 
school sessions were scfieduled with the students (individually and in 
groups) ,diirini) the serm^ster following evaluation and often times longer. 

finally, staff attempted to serve a facilitative role with teachers 
and counselors on implementation. This last role in the follow-through 
wjj-s significant. The school system was under no legal obligation to alter 
their programs and the a.greemen^ between ECO and the schools was to utilize 
existing resourc^^s in already heavi ly -extended school budgpts. Re-creative 
uses of available materials and time qf individual teachers and counselors 
Wc^s often the most productive vehicle for effecting needed modifications. 

The vocational evaluations of the students in the ICO program during 
1973-1976 was cqnducted in the Vocational .Development Center (VDC) at the 
University of Wisconsin-Stout. VDC functions both as a' client service 
program and as a clinical tfraining site at which students of the Un^iversity's 
undergraduate and graduate programs in vocational evaluation and adjustment 
can be provided supervised clinical experience. With this clinical training 
function nested into and supporting the client services function, an almost 
ideal 1:1 cl ien t/evaluator ratio was obtained. Practicum students and 
interns principally conducted the evaluattons under heavy and constant 
supervision of key VDC staff and University faculty, 

r 

12 is 



^ Other factors also caused the ECO evaluations to occur under almost 
ideal conditions. VDC Is one'of the best equipped facilities; is located 
at a i)n i vers ity' well known for its leadership in service, training, materials 
developmtmt, and research on vocational evaluation; and has facilities for 
housing clients during evaluation. Next,, during the major portion of time 
the ECO project was funded, ECO offices were housed either in or near 
the VOC, such that close monitorir^g of the direction of evaluation and 
student- progress could be undertaken by project staff. Too, the repertoire 
of psychometrics and work samples and projects which could be drawn upon 
for a given student's evaluation was extremely extensive and all were cata- 
logued by client functions against the standard codes of the Department of 
Labor's classification system as presented in the Occupational Handbook 
and Dictionarxo/ Occupa'tional TUles. 

Evalu^ions were also conduc.ted under a relatively well agreed upon 
model of vocational evaluation which involved an extensive and comprehensive 
use of individual work samples and systems and direct observations of work 
behavior against ^a backdrop of psychometric assessments and continuous 
feedback of evaluative findings to clients. A guidance and career explora- 
tion function was intended as part of the traditional data gathering function 
of evaluation such that the client would have the opportunity to collate 
findings, test out perceptions and tentatively make decisions during the 
actual course of the evaluation. 

Evaluations were conducted over a 2-week period of time for a total 
of 60 hours of contact in evaluation. Each evaluation cost $240.00, plus 
$40.00 for room and $55.00 for board. These costs were paid through ECO 
project funds. During the week, students were housed in the University 
dormitory (with only minor exceptions of districts quite close to the 
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University). An advantaqe of referral to the ^niversity settinq, rather 
than a school setting, may then be that students^received special atter>tion 
or were removed from school and social circumstances which could be related 
to their problejiis as reluctant learners. 

The core evaluation reconmended by ECO for reluctant learners is dis- 
played in Table 1 (CESA's 5 and 6, n.d., C-44). It involved a fairly 
thorough psychometric assessment of the student's abi 1 it ies interests , 
aptitudes and temperaments, complemented by direct observation of these 
san>e traits Mn the six traditional occupational ,clusters evaluated by work ^ 
samples and «n occasional situational assessment or special project. It 
was estimated that this core evaluation would require between 30 and 36 
hours of the total 60 hour evaluation. The remaining time was to be spent 
in evaluative and guidance activities determined by the evaluator and his 
supervisor, based upon needs of interests of the student. 

In 1974, a thorough analysis of the evaluation process for the 119 
students who completed evaluation that year was conducted. This analysis 
was undertaken to establish the parameters of the vocational evaluation;^ / 
to determine, the relative emphasis of guidance and counseling to evalu- 
ation; and to develop a reduced and potentially transportable program that 
might be used witWn the school context. The analysis consisted of cata- 
loguing every psychometric work sample and special project that 'each of 
the 119 students took in the 60 hour period, and then estimating time spent - 
in each task using average administration times. 

Table 2 summarizes this analysis by evaluative technique used (e.g., 
psychometrics) , person-traits (e.g., intelligence), and DOT job cluster 
(e.g., structural). Based upon percent of students tested or assessed, 
the relative emphasis given to assessing a trait (e.g., the intelligence 
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Tahle 1. Core Voc.dt''ional Evaluation Recoinnended for ECO Students 



'5YCH0METRIC EVALimHON 



I- 



Intel 1 i(jence 
A()t i tude 

Interest *" 

Tt:inf)erdments 

Achievement 
Dexteri ty 



Weschl er Adul t Intelligence Scale or' 
We^chler 'Intel Hgence Scale for Children 

General Aptitude Test Battery 
Bennett Mechanical Comprehension or 
Minnesota Clerical Test 

Interest Checkl ist 
Singer - Modified 

California Occupational Preference Survey 

Tennessee Self-Concept 
Edwards Personal Preference Schedule or 
Eber's 16 P.P. 

Wide Range Abilities Test 
ABLE 

Purdge Peg hoard 



WORK SAMPLE EVALUATION* 



Professional Techincal and 
Managerial (0 & 1_ . ) 

Clerical and Sales (2 ) 

Service (3 . ) 

Machine Trades (6 . ) 

Benchwork (7" . ) 

Structural (8 .) 



Minimum of -2 
Minimum of 3 

Minimum of 1 or Special Project 
Minimum of 3 
Minimum of 3 
Minimum of 1 



SITUATIONAL ASSESSMENT *. 



Special P»^oject/Act ivity/ 
Tour 



Minimum of. 1 



* At least 4 of the 12 work samples from the singer system were to be used and 
the TOWER and- JEV's work samples as appropriate. The numbers in brackets refer 
to DOT codes for the occupational cluster. 
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of .97T. of the students was assessed) and to evaluating the students in 
.particular occupational clusters (e.g., only 43% were evaluated in the 
PrpfessionaJ , Technical, and Managerial cluster) .can be estimated. By 
using the adjusted mean number of tests taken, the number of measures 
generally administered to each student under. a trait or cluster can be 
estimated. Then, based upon the incidences of tests/work samples admin- 
istered, the niost typical ones administered can also be identified. 
Final 1y» by totaling the approximate minutes for the work samples and/or 
tests, as shown at the bottom of Table 2, estimates can be made of the total 
time and the relative emphasis given to psychometric assessment, work sample 
evaluation and situational assessment and to guidance, career exploration, 
review of evaluation findings, or other activities. 

The 119 students were administered 754 tests, 1871 work samples, and 
took part in 121 special projects. Between 16 and 18% (9.5 to 11 hours) 
of their evaluation was spetit in psychometric assessment and generally 
conformed to that recommended by the ECO program outlined in Table 1; 
between 26 and 34%/ (16-20 hours) were spent in work samples, and another 
insignificant 1% (3/4 of an hour) spent on special projects. In work sample, 
evaluations, the predominant evaluation was on Machine Trades, Benchwork, 
Clerical, and, to some extent. Structural occupations. Professional, Tech- 
nic5(l, and Managerial occupations were least emphasized with individua*! 
work samples, but were picked up with the Singer, Tower, and JEV's systems. 
During the evaluation, the average client was administered approximately 
10 tests which took between 9.5 and 11 hours and was administered approxi- 
mately 16 work samples or special projects during an additional 16 to 21 
hours. These accounted for 25 to 32 hours of the evaluation time. The 
remaining 47-58% (28-35 hours) were sp^t in 1-to-l reviews, discussion, 
breaks, preparatibn, and vocational exploration activities. 
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Tab]« 2. Psychoffwtrlcs and Work Saitiples 



TESTS AND INSTRUMENTS 
EVALUATIVE TECHNIQUES , Number Times 



AND ^HPMASES 



STUDENTS 
INVOLVED 



Used Administered Numb.er Percent 



(1) 



PART A. PSYCHOMETRIC ASSESSMENTS 
Intelligence ? 

Apti tude^General ? 
Aptitude-Specific 6* 



(2) 

116 
118 

87 



(3) (4) 



116 

ua 

74 



97 

roo 

62 



Interest 



?47 



118 99- 



Temperaments 



220 



110 95 



Achievement 



272 



116 97 



Dexterity 



132 



98 82 



TOTAL: PSYCHOMETRIC ASSESSMENTS 



PART B. WORK SAMPLE EVALUATIONS 

Professional, 5 

Technical , 

Managerial 

Clerical and Sales 18 



Fanning, Fishing, 
Forestry 

Machine Trades 



2 

19 



7r>d 
55 

273 

5 

328 



' 52 
103 

5 

112 



43 



86 



4 

94 



Bench Work 



12 



324 



107 89 



Structural 



92 



69 / 57 



Mlsctllantous 



38 



27 22 



Most Tj'plcally A<*m1n1$tered to ECO Students In 1974 



MEAN NUMBER GIVEN . 

TO EACH STUDENT Approxirnate Minutes Most Typical. Instruweat arxl 

Raw Adjusted ^ to Admin Istfr Estimated Minutes to Administer • 

(5) (6) (7) ^ (8) (9) . 



KOO .97 90.00 • 

90,00 

1.00 1.00 180. 00 

180.00 

1.17 .73 30.00 

30,00 
(50.00) 

2.09 2.07 62.50 

30,00 
32.50 

1.92 1.84 60.00 

30.00 
30,00 

2.34 2.26 140.00 

20,00 
120.00 
(25.00) 

1.23 1.10 ■ 7,00 

7,00 " 
( 10.00) 

10.83 9.98 569.50 (654,50) 



Wise (90)/WAIS (90) 

General Aptitude Te^t ffattery(180) 

lennett Mechanical Comprehens1on( 30) 
Minnesota Cler1cal(50) 



California Occupational Preference 

Survey(30) 
Interest Check! 1st(45)7s1nger(20) • 

16 P.P. (30) 

Tennessee Self-Concept(30) 

Wide Range Abilities Test(20) 
ABLE 11(120) 

SRA Math(25)/SRA Read1ng(25) 

Purdue Peg Board(7) 
Bennett Hand Tool (10) 



1.05 - .45 

2,65 2.27 142.50 

1.00 ' .04 

2.92 2.74 94.00 

3.62 2.68 'bo. 00 



(67,50) Survey1ng(45)/Pen and Ink(90)" 



22.50 Bookshelv1ng(25)/We1gh'Prec1s1on (20) 

120.00 Cash1er-Checker(120) 
(35.00) File 90 (35) 



(80.00) Jig Ty1ng(90)/So11 Test(70) 

38.00 Eye-Hand-Foot Coord1nat1on( 38) 

11.00 Assembly* Mechanlcal(ll) 

45,00 Inspection* Nuts and Bolts(45) 

8.00 Visual Pursu1t(8) 
12.00 ^ Mechanical Apt1tude(l2) 

60.00 Assembly, Br1dge(60) 



1.33 ,75 30.00 

1,40 .30 ^- ( 



30.00 Silo Ladder(30) ' 

(100,00) Welding Arc(lOQ) 



(80.00) Sortlna. Mttal Scr»w(80) 

(15.00) Packaging and Heat StaT1ng(15) 



Singtr Systtm 



Tower System 



Jrvs System 



12 



20 



2) 



TOTAL: WORK SAMPLE EVALUATIONS 



PART C. SPECIAL PROJECTS 



279 



214 



263 



1871 



V^O 92 ' 2.53 2.32 



76 64 



3.tt2 1.80 



«1 2.71 2.19 



26.68 • IS. ,47 

A 



255.00 



195.00 



150.00 



127.50 

127.50 
(105. 00)- V 



100.00- 

95.00 
(60.00) 



90.00 
60.00 
(75.00) 



946.50 (1219.00) 



Electrical W1r1ng(165)/Weld1ng 

Draft1ng(90)/Bas1c Tools(165) 
Refr1gerat1on(165)/Sales and 
Off1ce(45) 

Business Ar1tlhmet1c(120)/Payron 

Compiitat1on(80) 
Typ1n9(90)/Record Keeplng(tOO) 
Free Hand Sketch1nq(90)/Blue- 
^rlnt Read1ng(30) 
• « » 

Adding ^lach1ne(90) 
PU>e Assembly(90) 
Large Lock Assembly(90)/Payroll 
Computat1on(60) > 



erJc 



Projects 



TOTAL: SPECIAL PROJECTS 



15 



121 



121 



79 16 



SUMWRY 

PSYCHOMETRIC ASSESSMENT TOTALS 

Minutes 

Hours 

Percent 

WORK SAMPLE^EVALUATION TOTALS 

Minutes 

Hours 

Percent 

SPECIAL PR0JE;CT TOTALS 

Minutes 

Hours 

Percent 

CAREER EXPLORATION/RESIDUAL TOTALS 

Minutes 

Hours 

Percent 



1.53 



1.53 



10.83 



.24 



.24 



9.98 



1871 



26.68 



15.47 



121 



1.53 



.24 



INTERPRETIVE NOTES: 



Colunn 4 
Colunn 6 



(Colwm 3 ♦ 118) X 100. 
(Coluiir 4 X Coluim S) i 



(45.00) 
(45.00) 



(654.40) 
10.90) 
18.18) 



(1219.00) 
(20.32) 
(33.86) 



(45.00) 
(0.75) 
(1.25) 



2084.00 (1681.50 
34.73 ^ (28.03 
57. §8 (46.70) 



569.50 
9.49 
15.81 



946.50 
15.78 
26.29 



Tour Vocational Technical 

lnst1tute(45)/Tour Stout 
(45) 



Column 2 ♦ Column 3. 



Column 5 
100. 

inVir ^* •^^^^^^^^ minutes to administer each device *re In' "()" 
«nd when more than one ^ght have been used, they are separated by V". 

Jliln ?nTo?lIJI^^?.^'^^^^'T^'' assessm.nt or evaluation Is 

a ^ In ^'^I Temperaments. 60.00 minutes). Average times 

«1vtf> to Mch «sst$smnt or evaluation are presented In Colufm fifor 



the devices Isted In Column 9. Minutes In "{)" In Colunti 8 Indicate 
that the device In Column 9 was ocasslonally used, but those minutes 
are not included in the totals of Colunti 7. 

Totals for each part of the table are arrived at by adding all values 
In each column, 1nc!ud1ng values In "()\ Thewefore. Colmm 7 gives 
typical number of minutes and Colurm 8 gives the maximum number of 
minutes. 
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An Alternative Program 

In 1974-75, evaluators were asked to catagorize the reconmiendatlons 
they were making to the schools regarding the ECO students into 12 cata^- 
gortes. For 72 students evaluated, evaluators made a total of 344 recommen- 
dations to the school for the students. In Table 3 are listed the types 
of recommendations evaluators offered along with their frequency and ranked 
order of occurrence* 



Table 3. 



Evaluator Recommendations Ranked by Frequency of Occurence 



TvDPS of Fvalur^tor 
^ Recommendations 


Frpflupn r V 
Recommended 


Ranked 
Frequency 


Vf^cational goal(s) related work- study 


49 


1 


Increased counselor/psychological contact 


* 40 


2 


Remedial/ tutoring programs 


39 


3 


Special vocational courses/programs 


37 


4 


Special academic courses/programs 


33 


5 


Class changes in academic areas 


27 


6.5 


General Exploratory work-study 


27 


6.5 


Special vo^ed out-of-school experiences 


26 


8 


Increased involvement with parents 


24 


9 


Class changes in vocational areas 


19 


10 


Course requirements waived or modified 


15 


11 


Other 


10 


12 



The complex of recommendations suggested in the five most frequently 
occurring types of recommendations relate to areas which are generally of 
concern in the school's career developm^rvt^and guidance emphasis. They 
reflect dimensions of many of the exemplary programs which have attempted 
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to integrate school experiences around a student's concept of work and 
vocdtioncll development. These reconmendations suggest to school guidance 



personnel a need to work with students as they establish vocationally 
rel(want goals and to also work with them in identifying those academic 
and vocational skill areas which are in need of reiii^diation , specialized 
development, and/or reality testing. 

In many of the effective programs employing a catalyst, major changes 
we^e introduced into tU^ context of the student's in-school experience. 
In the ECO program, changes were limited to those which might be integrated 
into the existing resources of the schools. Ferstenou (1976) studied the 
relationship between the degree to which evaluation recommendations were 
implemented and changes in ECO student grade point averages. He found a 
slight positive relationship at the end of the semester in which the stuclent 
participated in evaluation, but that the effects faded over time.^ His 
findings suggest that absolute changes rather than relative changes in 
programming may be necessary to sustain the ' vocational growth and develop- 
ment the student achieved through vocational evaluation. 

It could be expected that with evaluation and guidance joined as two 



components of a single catalyst within the school structure, the effects on 
students which were demonstrated through the program evaluation of ECO may 
be significantly enhanced. With a career guidance component as well arti- 



culated as is, the evaluation component, and the two systematically integrated 
as a program or course of one or two semesters duration, their^ mutual con- 
tributions should provide a really effective treatment/educative process 



/ 




fori.such a one or two semester in-school program 



is presented in Figure 2.- . 
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ASSESS 
PERSONAL 
TRAITS 




evaluate 
vocational 
pote;ntials 











I 



TEFOBACK 
AND 
RtVIEW 



I 



CAREER 
GUIDANCE 
AND/OR 
EXPLORATION 



No 




No 



ESTABLISH 
VOCATIONAL 
toAL(S) 



I 



IDENTIFY NEEDED 
EDUCATIONAL AND 
VOCATIONAL 
RESOURCES 



DEVELOP 
CAREER PLAN 



I 



IMPLEMENT 

CAREER PLAN 



1 



EXISTING 




MODIFIABLE 




NEW 


RESOURCES 




RESOURCES 




RESOURCES 















Figure 2. The Alternative Program Structure 

On 
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The alternative "bare-bones'.' diagnostic and assessment component in 
in-school programs might be constructed like that displayed in Table 4. 
The content of , this component is based upon adjusted ,neans and numbers of 
work samples and tests taken and the predominant tests and 
administered to ECO students (see Table 2). This alternative component 
maintains the original scope of the tCO evaluation'and the relative 
emphasis on psychpmetrics and work samples. 

In the model presented in Figure 2» tho assessment and diagnostic 
component is integrated with guidance and career exploration activities. 
Specific guidance,- career exploration, and vocational information activities 
are systematically interspersed following feedback from specific assessments 
of traits and aptitudes for different occupational clusrters. This provides 
the student with an opportunity to ful ly-explore the meaning and relevance 
of the evaluative findings and to maximize the integration of new or rein- 
forced understandings which may result for the student.l Similarly, ' plann ing' 
of each subsequent step. in the evaluation is then built around identifiable 
reactions and understandings which occur for the student. 

Formal vocational goal setting would occur at. the conclusion of voca-" 
tional evaluation and, as in the fCO program, needed educational and voca- 
tional resources would be identified. Given that the program takes place 
within the structure of the school, new or modified resources which might 
be needed for students' attainment of their vocational goals may be more 
readily obtained. If this program is conceived as a one or two semester 
course for students, the developmental effects could be expected. to be Opti- 
mal. Also, as conceived, the educational and vocational resources identi- 
fied could be provided in the school as needed. Finally, because these 
resource needs are Identified systematically over a relatively extended 



Table 4. Psychometr jc6 and Work Samples for an Alternative Program 



Personal Traits 
Intel 1 ujence 

Aptitude 
General 

Speci f ic- 
Interest 
Temperaments 
Achievenient 
Dexteri ty 



N uinbe r 
1 

1 
1 

2 

2 ■ 

Z ' 
1 



Average 
Time in 
Minutes 



Psych onie tries 



Vocational Potentials Number 

Clerical and .Sales 2 

Machine Trades 3 

Bench Work 3 



Structural 

Work Sample 
Systems 



Singer 



Tower 



JEVS 



Number 



2 
2 
2 



90 

180 
40 

30 
33 

30 
30 

20 
25 



Average 
Time in 
flinutes 

23 
120 

38 
11 
45^ 

8 

12 

7 60 

30 

Average 
Time in 
Minutes 



Weschler Adult Intelligence Scale or 
Weschler Intelligence Scale For ChiTdren 

General Aptitude Test Battery 

Bennett Mechanical Comprehension or 
Minnesota Clerical 

California Occupational Preference Survey 
Interest Checklist or Singer Interes.t 

16 P.F. 

Tennessee Self-Concept 

Wide Range Abilities Test on Able II 
SRA Math or Reading 

Purdue f^egBoard 



Individual 
Work Samples 



128 
128 

100 
95 

90 
60 



Bookshelving or Weighing-Precision 
Cashier-Checker 

Eye-hand-foot Coordication 
Assembly, Mechanical 
Inspection, Nuts and Bolts 

Visual Pursuit 
Mechanical Aptitude 
Assembly, Bridge 

Sdo Ladder 



Speci fi(i 
Work Samples 



Electrical Wiring or Welding 
Drafting or Basic Tools 

Business Arithmetic or Payroll Computation 
Typing or Record KeepTng 

Adding Machine 
Pipe Assembly 
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period of time by both student and guidance/evaluation personnel, effective 
<\ 1 1 0(:<» t i or) for them may be anticipated dnd planning for them most easily 
undertaken • 
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III. THE EFFECTS 'OF EVALUATION ON ADOLESCENTS 

> 

« 

The program evaluation of ECO was designed around the two goals and 
.perfonnance objectives set by ECO and displayed in Table 5. ECO intended 
to have impact on both the vocational development of reluctant learners 
and their school behavior. The evaluation focused on judging ECO's attain- 
ment of its performance objectives ,and on judging ECO's overall attainment 
of its two goals. Ferstenou (1976) also conducted a study on the relation- 
Ship of school's implementation to the school performance of reluctant 
learners. 

The general design of the evaluation involved collecting both hard 
and soft data from several different perspectives and at times most appro- 
priate to the effect predicted in the objectives. 

Hard data were in the form of student test scores on the Career 
Maturity Inventory (CMI) by Crites (1973)^ the Student Questionnaire (SQ) 
by De Amico (1972), and data provided from school records by counselors and 
teachers on student attendance, performance, grades, quantity of work, and 
social problems. The CMI is a norm- referenced measure of student attitude 
toward and competence for entering the world of work. Its attitude and 5 
Competency scales correspond to the 6 vocational development objectives. 
The SQ, in turn, is a semantic differential measure of student attitudes 
toward themselves in the context of the school. The SQ total score relates 
to general attitude toward school and SQ Scale 5 related specifically to 
students' attitude toward themselves. * 

Soft data were in the form of ratings of student attitudes, behaviors, 
vocational development and implementation of evaluat-fon recommendations. 
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Table 5. The Goals and Objectives of the ECO Program 



Goal 1. To Improve Vocational Development of Reluctant LearneVs 

Objective A: On the average, ECO students' ability to appraise their 
vocational and educational capacities will significantly 
improve. 

Objective B: On the average, ECO students' ability to utilize occupa- 
tional informatioji will significantly improve. 

Objective C: On the average, TCO students' attitudes toward career 

choice and entry' into the world of work wi*ll significantly 
improve. 

Objective D: On the average, ECO students' ability to solve problems 

related to school and choosing a career will significantly 
improve. 

•Objective E: On the average, ECO students' ability to formulate and 

select vocational and educational goals will significantly 
improve. 

Objective F: ECO students' ability to plan and prepare to enter the 
world of work will significantly improve. 



Goal 2. To Improve the School Related Behavior of Reluctant Learners 

A: ECO students' effort in and quantity and quality of 
school work will significantly improve. 

B: ECO students' adjustment, to school will significantly 
' . improve. ^ 

C:- ECO students' attitudes toward and interest in school 
will significantly improve. , 
1 

D: ECO students' attitude toward themselves will signifi- 
cantly improve. 

E: The school's attitude toward ECO students will signifi- 
cantly improve, following vocational evaluation.. 



Objective 
Objective 
Objective 
Objective 
Objective 
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Both hard data from school records and ratings of student behaviors were 
qatherod with locally develop(^d questionnaires: the Evaluator ^inmary 
(ES), the Project Staff Questionnaire (PSQ). the Teache^Questionnaire* (TQ) , 
and the Counselor Questionnaire (CQ). In all cases, ratings of ECO students 
were to be provided by the respondents with the referant being. "the typical 
student. " 

- E/.r'^5'\t^. on Voca t i ona l De^^ 

For each of ECO's Vocational Development objectives. Table 6 presents 
the perspectives and methods drawn upon to evaluate ECO attainment, the 
expected effects on the student, and the program evaluation findings. 

ECO had a definite impact upon the attitudes of students toward entry 
into the world of work and career choice. It also tended *to have positive 
impact upon the students' ability to appraise their vocational and educa- 
tional capacities, to solve problems related to career choice, and to^ plan 
strategies for pursuit of a career. These findings a^e reported by pro- 
fes^sional (school counselor and teachers) judgments and tend to be corro- 
borated with pre and post measures obtained from the CMI. By the end. of 
vocational evaluation, reluctant learners did not appear to have developed 
a capacity to utilize occupational information or formulate and select 
goals based upon the data sources employed in this evaluation. However, 
there is some evidence to indicate that this capacity dqes develop within 
one year o<f evaluation. 

The following observations are offered regarding attainment of each 
vocational objective: 

A. The students' ability to appraise their vocational and educational 

capacities were at a level commensurate with that of the typical student 
and change on the associated CMI scale was in the predicted direction 
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Table 6. ECO Attainment of Its Vocational Development Goal and Objectives 



00 





Performance 


EVIDENCE 




n 

EVALUATION 




Objecti ve 

V 


Source 


Instrument/ 
Form of 


Anticipated ' 
Effects- 


Observed^ 
Effects'^ 


Judgement 


A. 


Ability to appraise 
vocational and edu- 
cational capacities 


' Student 
Evaluator 
ECO Staff 


CMI-1 Scores 
ES Ratings 
PSQ Ratings 


Improve 

Level 

Level 


0 , 

+ 

+ 


Achieved - 
Inconsistent 


B. 


Ability to utilize 
occupational infor- 
mation 


Student 
Evaluator 
ECO Staff 


CMI-2 Scores 
ES Ratings , 
PSQ Ratings 


6 Improve 
Level 
Level 


0 n 

0 
0 


Not Achieved, - 
Consistent 


C. 


Attitude towr^rd 
career choice and 
entry into world 
of work 


Q \ 1 iHpn \ 

O l» Uvlc 1 1 l» 

Evaluator 
ECO Staff 


PMT — A ^pnr*oc 

ES Ratings ■ 
PSQ Ratings' 


Improve 

Level 

Level 


+ 
+ 
+ 


Achieved - 
Consistent 


D. 


Abil i tv to sol ve 
problems related 
to school and 
choosinq a career 


S t uden t 
Evaluator 
ECO Staff 


CMT-'^ Srnrp^ 
ES Ratings 
PSQ Ratings 


Improve 

Level 

Level 


0 
+ 
+ 


■ 

Achieved - 
Inconsi stent 


E. 


Abil ity to formu- 
late and select 
qoals 


Student 
Eval ijfltor 
ECO Staff 
' Counselor 


CMI -Scores 
ES Ratinas 
P-SQ Ratings 
CQ Ratings 


Improve 
Level 
Level 
Maintain 


0 

+ 

+ 


Achieved - 
Within One Year 


F. 


Ability to plan 
and prepare to 
enter world of 
work 


Student 
Evaluator 
ECO Staff 


CMI -Scores 
ES Ratings 
PSQ Ratings 


Improve 

Level 

Level 


0 
0 
0 


Not Aqh'ieved - 
Consistent 
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^Improve = Change in scores significant at p<.05. Level = 3.00, the level of the typical high school 
, student. Maintain - retain gain or level 1 year after evaluation. 

+ * as predkted by cri.terion, - = in opposite direction predicted, 0 = in predicted direction, but 
not at criterion. 
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The students' ability to utilize occcupational information was not 
affected to any significant degree. Ability in. this area remains below 
that of the typical student and may provide a continuing limitation 
to students in formulating and actualizing their vocational goals. 
The objective was clearly not achieved. 

The students' attitude toward career choice and entry into the world 
of work is highly positive and significantly affected by the project. 
All sources of data confirm improvenient in this capacity and that 
their development is at a very acceptable level. This objective was ; 
ful ly achieved. 

The students' ability to solve problems related to school and choosing 
a career are viewed by. both project staff and evaluation personnel 
as at the same abilities level as typical students. Change on the 
associated CMI scale tended to provide corroboration for their 
judgments (at a p<.10 level, rather than the .05 criterion level). 
This objective tends to be achieved, but not consistently, across all 
♦indicators. 

The students' ability to formulate and select goals was modestly evident 
based on changes observed in the CMI scaTe (at p<.10, rather than the 
.05 criterion level). Project staff reported that students can for- 
mill ate goals upon return to school, although this behavior is not 
universally so at the conclusion of evaluation. Significant improve- 
ment and maintenance of this capacity is als^o reported by counselors 
up to one year after evaluation. Ability to formulate vocational and 
educational goals is found to significantly increase by counselors.. 
By one year after evaluation, this ability is at a level similar to 




that of the typical student in the schools. Major increases occur 
during the semester of evaluation Ind are bolstered during the year 
following evaluation. This objective tends to be achieved within 
one year of evaluation. 
F. The students' ability to plan and prepare to enter the world or work 
is found to be below a level considered typical .for students. Project 
staff report this to remain so after a full semester back from 
evaluation. While some change occurred on the CMI scale and would 
tend to'indlcate positive improvement along this dimension, a lack of 
ability to employ this skill consistently, as reported by other 
sources would strongly suggest a sustained limit in this readiness 
capacity. This objective was clearly not attained with the present 
program complex. 

Effects on School Related Behaviors 

For each of ECO's school related objectives. Table 7 presents the 
perspectives and methods drawn upon to judge attainment, the expected 
effects on students , and the program evaluation findings. 

Attainment of objectives and progress toward this goal of establish- 
ing more positive behaviors in school is mixed, with generally good 
effects on specific dimensions. Effort and quantity and quality of school 
work significantly improved within one year of participation in the 
program in both vocational and academic areas. Students tended to be better 
adjusted to school after vocational evaluation, but this adjustment did 
not appear to be maintainied. Student interest in school was not consistently 
found to be as positive as for other students. Their attitudes toward them- 
selves Improved subsequent to evaluation and appeared to be maintained 
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after one year. Finally, they .tended to develop a better capacity than 
other students, to fonmjlate vocational goals, and do not appear to lose 
this capacity after a year back in school. 

The fol lowing observations are offered reqardinq each school related 
objective: ^ 

A. The students' effort and quantity and quality of school work is viewed 
durinq the seiiiester of evaluation by teachers as not significantly 
improved. The students remain • below the level of other students 

in the teacher's opinion. Initially, though, the teachers tended 
to view students nwre favorably than did counselors. Counselors 
report marked' improvement in quantity and quality of student school 
work after evaluation and report ""that these gains are maintained 
after one year. Their evaluation at these points in time tend to be 
similar to those that ard given to the "typical" student in the 
schools. There is a rather steady improvement in academic grades which 
is statistically significa^^t one year after evaluation (from a D to a C 
average). A major (but non-sigrl'ificant) jump tends to occur in the 
semester of evaluation and generally continues for one year after. 
There is also^a statistically significant improvement in vocational 
grades one full semester after evaluation (from a D to a C- or C 
average), with the greatest gain occurring in the semester following 
evaluation. These levels of attaitiment are ma-intained cifter one year. 
This objective tends to be achieved within orte year of evaluation. 

B. The students' adjustment to school is viewed by teachers as having nq^ 
major gains (at the onset, teachers tended -to view student adjustment 
somewhat better than school counselors), but counselors report improved 
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adjustimnit at the end of the semester of evaluation. According to 
school counselors, it continues to improve for one year with adjust- 
fiKMit approachinq that of the typical student by the end of the semester 
following evaluation. However, while there is a minor initial impact 
on attendance, this is not held over t)eyond the initial semester and 
tardiness tends to rise after one year. A contradiction also appears 
in that a fwdest (p^. 10) decrtvisc^ in the number of complaints indicated 
by the school staff regarding students, is not maintained after one year 
and appears to rise to the original level after one year, finally, a 
significant decline in contacts with the law occurs in the seiDester of 
evaluation, but rises to nearly the same level within one year after 
evaluation. This objective tends not -to be well achieved. 
The students' attitudes and interest in school., again, are viewed by 
teachers as not changed. Counselor estimates, though initially some- 
what lower, reflect a significant increase in student interest ar/d^posi- 
tiveness of attitude toward school. This significant increase ''il 
maintained one year after and reaches the level of positiveness and in- 
terest of the typical student. Evaluators and project staff report student 
interest and attitudes toward school to be slightly below that of the 
typical student in school and no significant changes in overall attitude 
were found when students were assessed with the Student Questionnaire. 
This objective tends not to be achieved. » 
The students' attitude toward themselves is found to be as positive as' 
that of, -other students by most sources. Student reported attitudes are 
not found to Improve significantly aft^ evaluation. The Student 
Questionnaire used to evaluate this is a scale which assessed the student 
self-concept in relation to the school setting and confounding may. 



therefore, hiwe occurred with this im^asure. The other sources of evi- 
(ItMKc, thoiKjfi, iFKliiMt(> \\h\\. studtnit attitudes do t(»nd to he at the 
same level as the typical student. This objective tends to^e achieved, 
r. The schools' attitude toward the student is reported to be at 

approximately the saim> level for these students as for the typical 
student, before and after the eval uat ion. ..Nevertheless, the schools' 
acceptance of the student significantly improved, and this level of 
acceptance is maintained for one full year after evaluation. This 

1 

\ 

objective was achieved. 

Ji"PJ>'"''^"A^ of Reco"i|iiendaj:jpjiji on School Performance 
Ferstenou (1976) conducted a study which sought to determine the 
effect of the implementati og of vocational evaluation recommendations on the 



grade point averages (GPA) of the reluctant learners who had completed the 
two week vocational evaluation. Existing data from the ECO project evalua- 
tioh were the source of data used in the analyses. 

Time series data were derived from the counselor questionnaires com- 
pleted at one semester intervals on 120 students who had completed voca- . 
tional evaluation and had "returned to the school environment. Categorical 
data on the extent to which' vocational evaluation recommen.dat ions. had been 
implemented during each semester were taken from these questionnaires and 
transformed in^to linear data using log transforma'^ion procedures. The 
transformed data were then correlated against grade point averages to test 



the hypothesis that the greater the extent to which recommendations were 



The results did not support the hypothesis: none of the obtained 
correlations reached a level of statistical significance. There were, however, 
trends in the data which tend to support previous findings obtained in the 



implemented, the greater 
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program evaluation of this project, as well as the clinical observations 
of the proqram ofH^rators. 

Specifically, there tends to be a positive relationship between 
implementation of reconm^endations and an increase in GPA at the end of the 
semester in which the students participati?d in evaluation. This is then 
followed by a negative trend over the next two semesters. -. In other words, 
there are immediate positive student effects from the vocational evaluation 

♦ 

process which carry over into a different setting. These effects, however, 
fade as time passes, with the extent of the fading most likely being related 
to the capacity and resources of the setting to make the major progranmatic 
changes necessary to deal with individual needs. Absolute change rather 
than relative change in programming may be necessary to sustain the voca- 
tional growth and development of the student achieved through vocatiopal 
evaluation. 
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IV, SUMMARY AND CONCLUSIONS 

The intents of this report were to describe an optimal vocational evalu 
tion program provided as part of a treatment of vocational and school behav- 
iors of reluctant learners; to suggest an alternative in-school variation 
of that program; and to summarize the effects which the original program 
had on reluctant learner ()ehaviors. 

In the course of the presentation, three perspectives of vocational 
evaluation were discussed respective to vocational evaluation's use in 
rehabilitation and Educational appl icatioas: as an information gathering 
proce.ss, as a client-reactive process , and, as a rehabil itative process. 
The central components of a variety of educational experiments were then 
discussed as catalysts for increasin9 the relevancy of education and for 
effecting changes in behaviors of special needs students. 

The Equal Career Opportunities Program was next outlined as a' three 
step program: in-school identification, out-of-school vocational evaluation 
and in-school follow- through. The** two-week out-of-school vocational evalua- 
tion was the catalyst in the program for affecting the vocational develop- 
ment and school behaviors of reluctant learners in rural schools. 
The structure, content, and emphases in the vocational evaluation are fully 
described. 

Based on the description and the research and evaluation studies con- 
•ducted on the program, evaluator recommendations, and effects on student 
performance, a two^componeat in-school mOtiel was proposed. Irl^thls model, 
vocational evaluation and career guidance and exploration are fully inte- 
grated such that the benefits of each are complementary. Evaluation and 

4 
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guidance are formally joined into a one or two sen^ester course, through 
which student'^ can establish realistic vocational plans and school personnel 
can obtain those resources most needed by students to realize their voca- 
tional goals. 

Next, the effects of vocational evaluation on studopt vocational develop- 
ment and school behaviors were summarized and presented as minimum levels 
which might be optimized with the model in-school program. The Equal Career 
Opportunities Program was found to have a more consistent impact on voca- 
tional development than on school behaviors. A definite impact. was made 
on students' attitudes toward entry into the world of work and career choice, 
and there also tended to be a positive impact on students' ability to 
appraise their vocational and educational capacities, solve problems related 
to career choice, and plan strategies for pursuit of a career. By the end 
of vocational evaluation, they did not appear to have developed a capacity 
totJtilize occupational information to formulate and select goals. Within 
one year of evaluation, however, they were able to formulate and. select 
- goals and their capacity for doing this tended to be better than that of 

other students. 

In terms of the program's impact on school behaviors, th^ effort and 
quantity and quality of students' school work significantly improved within 
one year of participation in the program in both vocational and academic 
areas. While students tended to be better adjusted to school after vocational 
evaluation, this adjustment was not maintained and their interest in school 
was not as positive as other students. Finally, their attitudes toward them- 
selves Improved subsequent to evaluation and appeared .to' be maintained after ^ 
one year. 
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